MVA: The Multimodal Virtual Assistant
نویسندگان
چکیده
The Multimodal Virtual Assistant (MVA) is an application that enables users to plan an outing through an interactive multimodal dialog with a mobile device. MVA demonstrates how a cloud-based multimodal language processing infrastructure can support mobile multimodal interaction. This demonstration will highlight incremental recognition, multimodal speech and gesture input, contextually-aware language understanding, and the targeted clarification of potentially incorrect segments within user input.
منابع مشابه
Max - A Multimodal Assistant in Virtual Reality Construction
In the Collaborative Research Center SFB 360 “Situated Artificial Communicators” the anthropomorphic agent Max is under development. Max inhabits a CAVE-like Virtual Reality environment where he is visualized in human size. Engaged in cooperative construction tasks, the human user meets a multimodal communication partner that employs synthetic speech, gaze, facial expression, and gesture. Combi...
متن کاملThe MUeSLI Multimodal 3D Retail System
This paper describes a multimodal spoken language system, which allows users to furnish a virtual 3D living room. Speech and touch modalities are tightly integrated in a single user i nput turn. An advanced dialogue manager allows users to have a natural flexible style of interaction with the "virtual assi stant" (a talking head). The system is mixed initiative, with a system intelligence which...
متن کاملVirtual Reality Assistant Technology for Learning Primary Geography
This is the preprint version of our paper on ICWL2015. A virtual reality based enhanced technology for learning primary geography is proposed, which synthesizes several latest information technologies including virtual reality(VR), 3D geographical information system(GIS), 3D visualization and multimodal human-computerinteraction (HCI). The main functions of the proposed system are introduced, i...
متن کاملYour Mobile Virtual Assistant Just Got Smarter!
A Mobile Virtual Assistant (MVA) is a communication agent that recognizes and understands free speech, and performs actions such as retrieving information and completing transactions. One essential characteristic of MVAs is their ability to learn and adapt without supervision. This paper describes our ongoing research in developing more intelligent MVAs that recognize and understand very large ...
متن کاملCo-located interaction in virtual environments via de-coupled interfaces
This paper describes an interaction style in virtual environments that allows co-located users to manipulate certain interactive features of virtual environments with 2D or non-inmersive types of input devices. The concept proposes to make interaction accessible to groups of users by mirroring some of the VE interaction characteristics and functionality and making them accessible from other typ...
متن کامل